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The purpose of the teacher-learner strategy (TLS) 
project is ostensibly to test different -instructional arrangements in 
different national contexts to sec vhich ones obtain the best 
results. The logic of this approach is coapellihg. iet it is the 
orderly appearance of the TLS project that sight be its greatr^st 
problen. The doctrine of external appearances refers to an 
intellectual and reductionist treatment of a problei such that once a 
systematic set of procedures that appear to address a problem is 
adopted, it is assumed that the prcblea disappears. That is, the 
systematic set of procedures becoaes the focus rather than the 
problem itself. Looking at the past, there is no evidence to support 
the viev that programs such as the TLS have made any difference in 
measurable outcomes or in processes of schooling. Even if the TLS 
experiments are designed in ways that are technically acceptable with 
respect to sampling and data analysis, the pitfalls of cross-national 
experijtents are overwhelming in four areas; specification and 
identification of treatments, the determination of appropriate 
criteria of effectiveness, the conduct of the experinent, and the 
interpretation and generalization of results. ( Jluthor/IEI) 
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EDUCATIONAL PLANNING AND TBACIIER-LEARNER STRATEGIES— 
THE NOTES OF A SKEPTIC 



Intr o duct ton ^ 
The purpose of the Teacher-Learner Strategy project is 
ostensibly to test out different instructional arrangements 
in different national contexts to see which ones obtain the best 
results. In principle, it would appear that this task has three 
phases: (1) the design of approporiate experiments with different 
teacher-learner strategies (TLS) ; (2) implementation of the 
experiments and data collection on results and costs; (3) design 
of educational planning strategics that encompass the results of 
the experiments. The objective of this exerctac* is to obtain data 
on what woiks best within given cost constraints, and to tise su^h 
information to Improve the effectiveness and efficiency of natjlonal 
educational systems. 

The logic of this approach is compelling. After all, everyone 
sevms to ^-.greo that the educational systems of developing 'societies 
havo never been ovaluaH-d sy s t ciiia L ica 1 ly with respect to the most 
appropriate snfratealcs that might be implemented. Second, the 
experimental approach is acknowledged to be the most powerful one 
for ascertatnlng the effects of different instructional treatments.^ 
Third, the tact that the needs of educational planners vtIH be 
taken into account in the actual design and implementation of the 
experiments means that there can be a natural bridge between the 
experimental results and the policy adoption of new approaches. 
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And fourth,. .th« popularity of educational reforms for political 
purposes can be harnessed to the "scientific" evaluation of 
alternatives and to the implementation of the tnost cost-effective 
one rather than educational reform simply being- undertaken for 
its own political vaJue with substance and effect a secondary 
consideration. 

The Fallacy . J>i„.Ext_Grjt_aJ^Aj) p^^e ranees 

Yet, it is exactly the orderly appearance of the TLS project 

which might be its greatest problem. For in its logic and systematic 

attentioja^to Implementing what works best is a major pitfall which 

r will call thu doctrine of exturnal appearances. The doctrine of 

external appearances refers to an intellectual and reductionist 

treatment of a problem such that once a systematic set of procedures 
> 

is adopted^, that appears to address a problem, it is assumed that 
thf problem disappears. That is, the systematic set of procedures 
bocomt) the problem focus rather than the problem itself. Education- 
al Planners and researchers then concentrate on the technical 
aspects of experimentation, evaluation, and implementation while 
a^5st^mlng that these are the Issues that must be attended to. Lost 
in this attention to the external appearances is the substance of 
the problem Itself a^id the assumptions that link these activities 
CO the problem solution. 

To glvf Just one example of the doctrine of external appearances, 
there ts a tacit assumption that the complexity of interactions 
bftwyen teachers and other adults and students and among students 
can molded by educational planners, if only we can determine 
which TLS strategy is most preferable from a cost-effectiveness 
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pclnt of ,i.w. Thu.. if It could b« .ho»n that . ...tery 
learning approach In a traditional aducatlonal syscem requires 
enormous changes U the technical prof Iclenclos of teachers, 
organization of schools, availability and use of curriculun. 
and the values and attitudes of teachers, students, parents, 
and other persons. 

There is a tacit assumption that educational planners are 
m a position to alter all of these aspects of schooling in 
order to unpicmont the best approach. Yet, an alternative 
formulation of th- devolopment „f schooling suggests a more 
historical approach. According to this approach the schools re- 
present an historical response to the emerging industrial order. 
Inculcating those traits that are functional to industrialism 
that could not be socialized in the more traditional family and 
community settings. ^ That Is. historically the forces that mold- 
ed the specific form and the expansion of schooling were not the 
rational desires and activities of educational, planners, but the 
forces of Industrialization that required a socialised labor 



In ihi;;- lattrr vor.siun t ho arl.s of vducnt tonal planners 
w«re strictly acndvuMc or el.sc. they wore trivial. They were 
academic In the sense that the plans and estimates from the plan< 
ner's drawing board were not the crucial determinants of the 
direction of educat.^.onal development as cvldv.nced by the wide 
margins of errors in manpower planning approaches and student flow 
models. That is. a retrospective review of the fruits of these 
oxerci..o.. sugr.u.t.s that they had very little impact on actual 
oducatloual outcomes. Thoy«.rc trivial In thei;en^;o that they " 
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addressed crnly the building of classrooms and the expansion 

of a te/ichinfi force rather than focusing on the substance of 

- o 

tho teacher-learner situation. 

But, If educational plajuu-rs have not even had much effect 
♦on tnttlatlrai and impU-nftnr inn the superilcLal logistics of 
oduciitional vxpaislon and chanRO, the TLS project suggests an 
even greater quandary. For the logical outcome of a successful 
soarch for a better teacher-learner strategy is an attempt to 
alter the s.ubst^an£e of the schooling process itself rather than 
Just its trappings. That, is, the unspoken assumption of the 
TLS project is that educational planners will be able to inter- 
v«nt. and alter the intricate set of social-psychological inter- 
actions of th« educational process on a national scale. 

That educational p nners have been mere handmaidens in the 
pr()f(!ss of educational development rilther than the forgers of 
thf process i:j refU-cted in the history of such activity. That 
i:;, they can support the political endeavors of the society in 
i.-xpautl i nr. s.-h<u>ling by calculating "manpower needs" or social 
demands, and they can assist in implementing these "needs" 
throiiKh uumer i cal exerc Iscs with respect to teacher needs and 
rlas.jruom netds. But, they do not mold the nature of the expansion 
or t}u- substance of the educational experience. These seem to 
be far more dependent upon political, economic, social, and cultural 
t^'ires and Llie values of various groups of students, parents, 
ti'acli.rs, aivd other adults who comprise the educational enterprise.^ 
What evidence do we have that the most appropriate TL.^' design that 
en-er^es from an experiment for any given society will actually 
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b« laplttasntablA In that socictyT 

It is sobering to consider the experience at implementing 
even nominal reforms that attempted to Intervene l%i teacher- 
learner process in the United States* For sevdrrfT decades , 
there have existed projects to retrain teachers in subject matter^ 
teaching methods, knowledge of particular cultural groups, new 
modes of curriculum organization and so on* At a more specific 
level they have Included new staff ing patterns team teaching, 
open Classrooms, flexib^le modular scheduling, educational radio 
,.and television, racial desegregation, and changes in school 
governance* I will make the following strong generalization in 
describing the results of these changes* THERE IS WO EVIDENCE TO 
SUPPORT THE VI EW THAT THEY MADE ANY DIFFERENCE IN MEASURABLE OUT- 
COME OR PROCESS OF SCHOOLING *^ In many cases, it. is not even 
clear that anything except the external appearances were even 
implemented.^ Yet, many of these projects were fostered by major 
innovators and universities in nettings which were considered to 
be highly amenable to change. 

This brings us back to the doctrine of external appearances. 
If the history of educational reform is completely devoid of 
success in the e'ducational planning sense^^-^in contrast with a 
pattern of educational development that corresponded to changes 
in industrial capitalism--ihen how can we proceed with a TLS 
project that assumes that results will be used by educational 

planners ,to improve jLational educational systems? The evidence 

/ 

suggests that educational systems change in response to changes 
in the super-structure of society, and not the reverse. The 



fact that educational planners, researchers, academics, educators, 
. and pol'lrlcal leaders -talk about exlucational reforms and Issue 
national .plans. for changing the educational system\ls part of the 
ideology of external appearances. The tact that there, is little 
or no documentation of success^'in actually implementing such 
change is in .<.tark contrast to the extfernal appearance of rat.ional- 
ity and planning and research that arc inevitably used to legitimate 
that such planning and reform are actually taking place^, even though 
they ace not. 

The point Is that thero is not much evidence that educational 
planners can implement new teacher-learnc'r processes^ on the basis 
of the "proven" sjiperlority of the. new processes' over traditional 
ones. If my contention i^ correct, the TLS project should 'not be 
undertaken for its usefulness in assisting educational, planners 
a.s much a^s^for.its usefulness in assisting educational researchers. 



liut. if the TLS project is designed to provide -basic data on 
fUllorynt TLS models in different national sot t ings ^ there is 
auuthor 'set oi prohlumr. that win have to be confronted. These 
iuobloms arc uolther unlquo to TLS conco.pt, nor Jre t hey spec i f Ic 
to a .curvoy o f cVoHS-uat iona 1 scope. But, as I will describe 
below, tht'Y are exacerbated in these cases. V 
CX^V^^l.rJii^i_i^^i.L« 1. Ex periment s and The ir Pitfalls 

Let us aHHume that the experiments are designed in ways that 
are technically acceptable-with respect to sampling and data 
analysis. That is,»students and teachers- will be randomly assign- 
ed to treatments fcither as individuals or as clusters. The appro- 
priate data collection and comparisons will be ejnployed, in 
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principle, to evaluate the experiments. Even if we can aasume 

this to be the case—one of the first times in the history 
of large-scale educational experimentation that it would be- 
there are matters of substance that are even more difficult to 
7 

address. These Include the precise specification and identifi- 
cation of treatments; the appropriate criteria of effectiveness} 
the conduct of the experlmen>t; and the interpretation and generali- 
zation of results. , * 

In the remainder of this note, I will refer to problems of 
doing a cross-national TLS experiment or set of experiments. That 
is, it will appear that 1 am not referring directly to the im- 
plications ot the separate i/ational projects that will b.e. discussed 
at the TLS seminar in March 1976. In fact, there is a direct con- 
nection between the characteristics of an experiment, and those 
of the TLS Boralnar. For, if it will be difficulty to draw reliable 
conclusions from a -set of experiments on the subject, consider 
the oven greater unreliability of comparisons based upon a set of 
separate national projects. Accordingly, the problems and criti- 
c.i/.mii that I will act uut below would suggest that the advisability 
••of a cross- nat ional set of experiments on the subject would be 
of dubious policy value for both cross-national educational re- 

7 

searchers and for educational planners. Inferences drawn from 
cross-national cotrtpa r i-s'^'^i'^Ss^^ cross-strategy comparisions based 
upo-n tRe separate national projects that will be reported at the 
seraiijiar will he even shakier. 



specification a nd Identification of Treatments 

• The present description of different teacher- learner^ 
strategies is useful only as a first approximation for the 
actual treatments that will be employed. Just the crudest 
dimensions of the different treatments are set out, and most 
of these are rTela.ted to the orsanizatlon of the classroom and 
curriculum rather than to the more intricate attributes of the 
personnel and their interactions with the classroom an<i cur- 
riculum organization and the students. But, retrospective ' 
evaluations of what are viewed as similar innovations' in the 

> 

schools suggest that quite different treatments are taking 
place ta settings evert when innovations are characterized a., 
similar., In Britain, the so-called "infant schools" differ in 
substance from setti<ig to setting even though both physical space 
and time are used similarly among such schools. Authoritarian 
teachers in one such location create quite a different interaction 
than do those who encourage experimentation among their students, 
even though both will appear to be goin^ through the same motions 
with respect to use of the facilities and curriculum. 

The point is that the present specification of treatmenfs 
Is so vague in atj operational sense and differences in organi- 
zation of classrooms and curriculum can be so easily offset by 
personnel factors such as attitudes, values, and capabi 1 i i. ies 
which affect their behavior, that a far more precise specification 
and ident if icatlon of actual treatments will be necessary for 
the experiment. But, such an exercise can neither be done from 
the drawing-board, nor can one rely upon each national entity to 
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piirHttu ll« own vcrsiuM ol.tho TLS. Wc arc facoU 

with the paradox that to be more prcclaw requires nddressing 

c 

directly the actual fmplementat ion of the ex,per:tment In the 
fields and «uch precision can only be done in retrospects In 



the best laid plans of men will always be imperfectly im- 
plemented. We can not/ create experimental treatments by 
. recipe, because even if we could select precise amounts of 
homogeneous ingredients In every important ri*spect, we can not 
predict the effects and interactions that the combination of in-- 
gredients has oh altering the nature of the result. That is* 
educational personnel and students are not inert aspects of the 
treatment, but they can affect it in unpredictable ways. There- 
fore, an identification of the actual experimental (and control) 
trtiatment requires a precise specification and identification 
of what a.*--L'i''llA.>l took place rather than what was httcrapted or 
planned. * 

It huch documentation were a part of the experiment, would 
It bo uiiftul? First, it would have to be standard t ssed among 
sites, and differences among observers at particular national 
settings wiiJ create non-reliability in assessing differences 
among exper im'en ts . This is likely to be true even if a standard 
ized instrument for documenting treatments is used because we 
lack the knowledge base for measuring precisely the nature of 
♦•'instructional interac t ions, and there is likely to be a high 
probability of overlooking subtle, but crucial, factors. Even 
if we send the same set of "exports" to each site to assist in 
C the documentation, thcr« itlll e«U^'> previous, deficiency 



any area as complex as an in vivo educational experiment, all 
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of on inadequate knowledge base and the further danger that, 
short term assessments will measure transitional phenomena 
during an experiment characterized by instability and change 
as a new approach is implemented^. In the United States the 
problem of imprecision in the definition of treatments has led 
to the situation that even when experimental differences are 
found in favor of a particular "treatment", one can not be 
certain of what actually workt-d. In fact, replications of 
experimental results from instructional treatments and resultant 
generalizations are virtually^ impossible to find.^ 
Criteria of Ef f.ectlve ne^gs^ 

Determining the appropriate criteria of effectiveness or 
success is a second problem in a cross~na t lonal experimental 
strategy. What is important in one society is not necessarily 
important In another one, and there exist differences even among 
sectors of a given society (e.g. urban-rural differences). It 
is true that there will probably be strong agreement among edu- 
cational planners and researchers about the broad criteria that 
are important. Such professionals share a common culture that 
la. based upon their common training and professional experiences. 
Most international educators have been trained at Institutions 
in the United States or in Western Europe, and the literature 
and values embodied In such training programs emphasize a few 
limited dimensions of cognitive achievement as the qualtiave 
dimension of education. But, agreement among educators or edu- 
cational planers is essentially an affirmation of their common 

U 



training aiid professional experiencss rather than an accord 



amonft their societies about what in important lu terms of 



.educational outcoraea. It is noteworthy that recent research 



accentuates the non-cognitive factors of personality develop 



mcnt and behavior as being more important in predicting success 




But, what are these factors? Unfortunately, they have been 
Investigated very little in a milieu in wnich the ideology of 
schooling presumes that cognitive achievement is the ingredient 
which cout.r ibu Les roost to national and personal development and 
welfare. Accordingly, there is a conceptual gap in specifying 
and measuring the criteria of effectiveness in general, and it 
is aggravated by the raed to differentiate among national entities 
according to their specific needs in contrast to general factors 
ot vf Eect Ivcncsij. Thus far the literature on the selectio'n of 
'educational triterla and their cross-national differentiation 
accorUiii}' to diftcrunt cultural, economic, political, and social 
ufeds !« highly inadequate. But, a cross-national ILS experiment- 
al prnjvTi muiit presume a relatively high uniformity in education- 
al goals and measures, and this commonality will be more a derivation 
of the commonalities in training and ideologies of educational 
planners and researchers than one based upon an examination of 
national and suh-natlonal needs (e.g. urban vs. rural). 



0( course, if different nations have different needs that are 
rt>flected by a diversity of criterion measures of outcome among 
countr if.s, tht;n the appropriate comparison should be that of ex- 
perimenting with different teacher-learner strategies in the sane 
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society. In this case, no cross-national comparislons would 
bo ma<le» but only Intra-natlonal comparisons. 
Conduct of Experiment 

1 assume that each participating country would manage its 
own experiments. The HEP would attempt to coordinate and train 
the investigators as well as assisting in designing the experiments. 
But, differences in the conduct of experiments in themselves will 
produce differences in outcomes. For example, differences in 
training among evaluators and researchers within countries and 
in such areas as testing will create their own effects. Nor can 
one be optimistic about avoiding such differences, given the 
relatively nominal involvement of the HEP in monitoring these 
aspects. One of the best-known experiments in the United States, 
that of educational performance contracting, was carried out. by 
the Office of Economic Opportunity. A single testing contractor 
was used for all of the eighteen experimental sites. Yet, there 
were vast differences in the test administration procedures and 
Lostlug conditions from site to .site that imparted their own 
pattern of bias to the tost results. Further, a single in- 
stitution was charged with monitoring the treatments and operations 
at the eighteen sites with the expectation that such an endeavor 
would tend to standardize the management or at least document 
diffcrencos In the conduct of the exper imcnt . This, procedure 
also failed to guarantee uniformity or appropriate documentation 
t» f tl I f f e r e n c e r. . 

Yet, if a single national agency in the United States employ- 
ing reputable research and management firms selected in a national 
competition are unable to assure uniformity In the testing and 

ERlC i6 
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th« conduct o£ the ..p„l«„t.. hovwui thl. b* po,.tbl, t„ 

the TLS project. I„ contrast to „ .m^ic country, there „ilx 
bo several, and U contract wUh havln„ a a.nnle not of contractor, 
carrying out tho testing, project ma„a«.„ent. and monitoring. 
-.U ot those t„„ctions „U1 be charged to the national governments ' 
.-.nd their local representatives at the e.perU,ntal sites. „hUe 
the HEP „tll train the project personnel In' short-ter™ Institutes. 
I have Uttl. Ulth that this activity „1U do any .ore than to 
smooth over the «ros.s differences In procedures that might have 
-er«ed without ttainl„«. t„ short, under the present set of ■ 
.»■.-. the auroroucs among Mtes In the conduct of the Individual 
oxrerlment. «il, necessarily be port of the "treatments" them- 
-Ues. While Uu-y are lIKely to have effect on outcomes. It 
win be an effect that wUl be difficulty or Impossible to separate 
from other treatment effects. . • 

l"-t.«; rHJ •■ ' ■•U_U, „ ,l<uL. fill" e raU.£a_tJ oj!_c^_ 

This hri,,,.. up the final- Issue, the Interpretation and general- 
'-•..t.„ „f „„„ ,..,,„ ^^^^^^^^^ ^^^^^ ,„„„,,ies 

with .li,re,,.,„ treatments that arc described according to 

-^•.■tn..,, .■uM..-..,nu... rather than actual Ingredients and processes. 
<nifc.,..u.,.. in „.,„.,ni., ration and testing, and so on. The .p..rpose 
or the T,,.s s,.,„lnar is to review existing projects In a number of 
soci,.,le3 that. „My fit one or another of the different TLS models 
in oroer to a,s.:ef.,.in their implications for educational planners 
.n> well as to as.siKt ,,,,:p ,„ planning further research on these 
matters. Much of the discussion and the presentations will be 
couched in the scientific terminology of experimentation and 
-valuation with technical descriptions of samples. Instruments. 
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trefttnSnts. statistical methodologies, end results. Yet» these 
discussions mey give a false sense of security to the i>articl- ^ 
pants. 

Differences among projects in all of their dlracnisions will 
be partially unobservable , as the projects are "fitted" to 
different TI.S models. Yet, the language of evaluation that will 
be used to describe projects will tend to be far more precise 
and uniform then will the underlying phenomena that have transpired 
or that are being planned. Accordingly, a major focus of the 
seminars must be that of addressing the inevitable ideosyncrat ic 
nature of separate projects that defies the standardization needed 
for comparison and for replication. This task is quite different 
than the more optimistic one of exploring their implications for 
educational planning, for the latter can not be done effectively 
without a far more precise., understanding of the strategies and 
their consequences. 
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FOOTNOTES 



1- Foe a view rocommentlinp tho uc. ..r 

for social policy formnJon IL [ experimentation 

Ina for S.oclal Action ( Was^l^^o^ S^p""' amejiatlc Ihlnk- 

Instltutro7rrr97T)~For a Brook iTgS 

and M. Timpano (ed.) pT,„!!,, °^ TLS. sec A. Rlvlln 

-"-£ Clv_e Tr^ . a^df^^s^^F^n^ SiHcatlon: should 

InseUuttouri975). — '"•'^''ington . D.C.; The BrookTSiT"" 

Basic Book..rfor^rcomi\7f1l7lf^^^^^^^^ ( ^ ontat ive^ t i t lo) (New-Y^rkT 

^ Inc. forthcoming 19T6)". David Mc Kay and Co., 

S. Bowlos and H. Gintl^ "rii«o o^. . 

Monmjr KevUu (March 1 975)! p^. ^s/ ^l^"""-'' ^^bor." 
•-9/4), pp. 304 -320. ' iii^HiLS:^, vol. 10, No. 3 (August 

Educational «t taintmH . '^oo: skf?^"'' P"for»ance. 

.-ee H. H. Levin, "A Decade of Po^lc! r« J " "-^"Ing'. 
ing Education and Training ?or ^ '■^^'^lopments in laprov- 

«ob..rt „avc.„„.n ( od . ) . A ne\ . ,° or^ccl^r"" iTi^'p' '""^ ' " 

Aril If votnrru s Km i I r~, — — - — Sif-"L?.i An t_t-Povcr t y Policv 

Thv i.„r ihnt ,,u. rh..i„ri,- „r rffoni, „r, 
■ '-IM-.. s..,., („r .' ,1 w Ut.orature on the 

t-M,t.T r„r th,; Advnnccr-5liiv--o7 Vr- 'r^ (E"g<-ne. Oregon:— The 
19?3); N. (;r,.s.s. J G^'cn.anr-, '•'^"j;" 1°"'>1 Amlnis t ra t ion . 
"'■.fc-A.-M.on,, n,iovat';;:r Lw ?o" k^-Ba^c^^i:'?' ia^^i^ilUl 
•ind S. B. Sacanon, Thrfuit.irn „f ? J ^ooks. Inc., 1971): 

/- The only .utempt to u«£« thi^ ' i 

tho united states harL^^an it^Zlt ZllV'":: T/""''' ^" 
evaluation and design expenditure of S25 i<f?. ''^''= " 
including the costs of the edurltiU "^^^^"^ °<- «<> (not 
the experiments). See R I vUn "J = °"!^" . ^"-"l-"' 
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the „.peri.ent;,r%e: .ll^l^^'Vl^^^^^-^ 
St.*. the roferencor. in footnote 6. 



th. research finclinR.s on teacher effLri^ '"''^'"f'^ «cncralUo 
anraW Uosenahino and Nor^^Furs /^h^i rr!^^^ ''^'n!' 
Study Toachin«." in Rohert m/ , 'rlall^^^^^^^^ 
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ISr-T^yTf H^^^^^' 1^ U^^:3SJif^ (New York: Rand He Nally' 
inc., 1973), Chapter 5 and tt« critical review 4n» S ^* 
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